Understanding Gaussian Process Regression Using the Equivalent Kernel
نویسندگان
چکیده
The equivalent kernel [1] is a way of understanding how Gaussian process regression works for large sample sizes based on a continuum limit. In this paper we show how to approximate the equivalent kernel of the widely-used squared exponential (or Gaussian) kernel and related kernels. This is easiest for uniform input densities, but we also discuss the generalization to the non-uniform case. We show further that the equivalent kernel can be used to understand the learning curves for Gaussian processes, and investigate how kernel smoothing using the equivalent kernel compares to full Gaussian process regression.
منابع مشابه
Using the Equivalent Kernel to Understand Gaussian Process Regression
The equivalent kernel [1] is a way of understanding how Gaussian process regression works for large sample sizes based on a continuum limit. In this paper we show (1) how to approximate the equivalent kernel of the widely-used squared exponential (or Gaussian) kernel and related kernels, and (2) how analysis using the equivalent kernel helps to understand the learning curves for Gaussian proces...
متن کاملMultiple Gaussian Process Models
We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data. Sparsity in the kernel weights is obtained by adopting a hierarchical Bayesian approach: Gaussian process priors are imposed over the latent functions and general...
متن کاملMachine Learning Approaches on a Travel Time Prediction Problem
This thesis concerns the prediction of travel times between two points on a map, based on a combination of link-scale road network data and historical trip-scale data. The main idea is that the predictions using the road network data can be improved by a correction factor estimated from historical trip data. The correction factor is estimated both using a Machine Learning approach, more specifi...
متن کاملDetermining Effective Factors on Land Surface Temperature of Tehran Using LANDSAT Images And Integrating Geographically Weighted Regression With Genetic Algorithm
Due to urbanization and changes in the urban thermal environment and since the land surface temperature (LST) in urban areas are a few degrees higher than in surrounding non-urbanized areas, identifying spatial factors affecting on LST in urban areas is very important. Hence, by identifying these factors, preventing this phenomenon become possible using general education, inserting rules and al...
متن کاملDesigning Kernel Functions Using the Karhunen-Loève Expansion
In recent years, a number of kernel-based learning algorithms such as the regularization networks [1], the support vector machines [7, 4, 5], and the Gaussian process regression [8] have been investigated. These kernel machines are shown to work very well on real-world problems, given appropriate kernel functions. For general purposes, the Gaussian kernel is widely used and seems to work well [...
متن کامل